For a convex function ff and points 𝐱(1),,𝐱(t)\mathbf{x}^{(1)},…,\mathbf{x}^{(t)},

f(1t𝐱(1)+...+1t𝐱(t))1tf(𝐱(1))+...+1tf(𝐱(t))f\left(\frac{1}{t}\cdot\mathbf{x}^{(1)}+...+\frac{1}{t}\cdot\mathbf{x}^{(t)}\right) \leq \frac{1}{t}\cdot f(\mathbf{x}^{(1)}) + ... + \frac{1}{t}\cdot f(\mathbf{x}^{(t)})

More generally, deriving from variance and expectation,
𝔼[f(X)]f(𝔼[X])\mathbb{E}[f(X)] \geq f(\mathbb{E}[X])


For concave function,


References:

  1. https://www.chrismusco.com/amlds2023/lectures/lec8_annotated.pdf
  2. https://www.probabilitycourse.com/chapter6/6_2_5_jensen's_inequality.php
  3. https://mathworld.wolfram.com/JensensInequality.html